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X r* 

The hypothesis that Shannons full-channel information capacity 
can be approached only in a communications system employing both ampli- 
tude and phase modulation (AM and PM) is the basis for this thesis. 

Phase modulation is discussed , PM and AM systems are defined and 
AM and Hi are combined into a single system. Error probability formulas 
are derived and applied to the system in the presence of carrier fading 
and Gaussian noise. 

Cyclic codes are introduced and discussed in detail. A cyclic code 
is selected for the system described above and its implementation and 
effect on the error rate of the system are described. 
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1 . 



Introduction. 



In a paper comparing the information capacities of amplitude and 
phase modulation communications systems [i] , N. M. Blackman concludes 

that the Shannon full-channel capacity can be obtained only in a system 
employing both AM and HI. Blackman’s conclusion is based, in large part, 
on probability and statistics and is quite analytical. This thesis is 
an attempt to exploit Blackman’s conclusion by proposing a combined AM- 
FM system and evaluating such a system under conditions of noise and 
carrier fading. Error probabilities and coding will be studied in 
detail. It is intended that this thesis proceed from theory to the de- 
scription and analysis of a reasonably practical communications system. 

In Section 2, phase modulation is discussed. The Fourier Transform 
Identity is used to represent a data wave modulating a carrier by means 
of a product modulator. The output of this modulator is a signal con- 
taining frequency components in a band centered at the carrier frequency 
and equal, in width, to twice the maximum modulating frequency. The 
maximum modulating frequency, of course, is determined by the highest 
frequency component in the data wave. During transmission, it is assumed 
that the signal undergoes changes in amplitude and phase due to the char- 
acteristics of the transmission medium. At the receiver, the signal is 
product demodulated by a reference signal identical with the original 
carrier shifted in phase and attenuated by the transmission medium. With 
certain assumptions on these characteristics, it is shown that the orig- 
inal data wave is obtained at the receiver, modified only in amplitude. 
That is, the phase information has been preserved in transmission. 
Therefore phase information is conveyed using only product modulators and 
demodulators. 
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In Section 3, the theory of the preceding paragraph is applied to 
the K4 system. A converter is described which changes the digital ( 0 
or 1 ) information into a sinusoid at a given frequency and at a phase 
( 0° or 180° ) which is determined by the state of the bit. This sinus- 
oid, then, becomes the data wave treated above and is used to modulate 
the carrier. After transmission, the modulated carrier is product 
demodulated and filtered and fed into a converter in which the origi- 
nal bit is restored. Further, it is shown that two bits may be trans- 
mitted at a time by having one modulate a carrier as above and the 
other modulate a carrier whose phase differs by 90° from the original 
carrier. Demodulation is the same except that the carrier is shifted 
90° before it is inserted into the product demodulator for the second 
bit. By means of phasors, it is shown that each bit may be recovered 
in a manner identical with that described above for a single bit. 

In Section 4, an AM system is discussed. Because AM is covered 
quite thoroughly in textbooks and in the literature, there is no dis- 
cussion of AM theory. Instead, two systems are described briefly* The 
amplitude of the carrier has two possible values, the amplitude being 
determined by the state of the bit. The first means of obtaining AM is 
a variable gain amplifier (VGA). An example of a VGA is a vacuum tube 
in which the carrier is applied to the control grid and the data wave 
is added to the DC plate or screen supply voltage. Another AM system 
is referenced but not described. It is the "A-l Data System" developed 
by the Bell System in which the data wave, basically, amplifies the car- 
rier by an amount dependent on the state of the bit. In either case, an 
envelope detector must be used in conjunction with a threshold device to 
detect the state of the bit transmitted. Specific values of the ampli- 
tude levels are discussed below in connection with error rates (Section 8). 
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In Section 5, methods of combining the AM and PM schemes into a 
single subsystem are discussed. Further, the possibility of frequency- 
division multiplexing (FDM) several of these subsystems is proposed and 
discussed briefly. Basically, an AM-IM subsystem operates on three 
bits at a time. One of these bits is handled by AM and the other two 
bits by IM. A semi-analytical approach is taken to outline the possi- 
ble states of the system and, a signal space is indicated for an AM-PM 
subsystem. Finally, five subsystems are combined using FDM and, for 
the first time, provisions are made for error detection and correction 
(EDAC) . 

In Section 6, the error probability for the AM system is studied. 
Gaussian noise is assumed along with carrier fading described by the 
Rayleigh distribution. As a first pass at the error probability, it 
is assumed that there is no carrier fading and an equation for the prob- 
ability of a detection error is derived. This equation is a function of 
signal to noise ratio (R) , relative threshold level (a) and relative 
signal level (k) applied in the error function (erf) often referred to as 
the probability integral. Next, carrier fading is assumed present and a 
similar derivation leads to an equation for error probability. Finally, 
an optimum value of the threshold level is obtained as a function of the 
relative signal level and noise level. 

In Section 7, the error probability of the FM system is studied. 
Noise and signal phasors are used to analyze phase-modulated communica- 
tions systems including the case of a system subject to carrier fading. 
Equations for error probability are obtained and are seen to be depend- 
ent upon the same variables as the AM system above. 

In Section 8, the results of the two preceding paragraphs are 
combined for the AM-IM system. Equations for the probability of one, 
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two or three bits in a group being in error are obtained. The computer 
program for error probability calculations (see appendix) is discussed 
and comments concerning the program output are made. Again, the problem 
of selecting a relative signal level is attacked and results tabulated 
for several signal to noise ratios. Finally, the effect of FDM on error 
probability is discussed. 

In Section 9, cyclic coding theory is introduced. Cyclic coding 
was chosen because the same or similar codes may be used in the system 
regardless of the number of subsystems which are multiplexed together. 
Polynomial representation of binary information is discussed and princi- 
ples and theorems of cyclic coding theory are stated. Finally a specif- 
ic code is selected for the system. The code is applicable to a message 
containing up to eleven information bits and four EDAC bits, will correct 
all single-bit errors and will detect over 90% of any type of error in- 
cluding multiple burst errors. A means of implementing this code is 
presented and described. 

The last sections draw conclusions from the thesis and make recom- 
mendations for further study of the AM-FM Digital Communications System, 

An appendix is included giving error probability calculations out- 
lined above. 
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2. Discussion of Phase Modulation (Rl) ♦ 

It will be shown, in this paragraph, that a product modulator is 
suitable for phase modulation purposes. 

A product modulator forms the product of two signals, a data wave 
(signal) and a carrier wave. The data wave carries the information to 
be transmitted and the carrier wave transmits, or transports, the data 
wave to some other point. Let the signals be denoted as follows: 



Data Wave 
Carrier Wave 

Product Modulator Output 
By the Fourier transform identity, s(t) may be represented as follows 
where is the maximum (limiting) modulating frequency: 



s(t) 

cos(uj c ^ + e ) 

v c > 



S(*) = jp- j S (u>) CJSS (o-> -k + $(&)) Jco 



The modulator output, X^(t) , is: 

X* (±) - s(t) coo/ ( uJc.-£ + e) 



UJ L 

— -Zjf Js (. UJ ) (t *j<.± -+ 0 ) 00-0/ ( L 0~t -h <£> ( u/)J Ji (jj 



At this point, the symmetry of S(u>) and should be considered. 

Let the Fourier transform-mate of s(t) be denoted by F (.uJ) # Therefore, 
F(oj) =SM 

In Fourier transform theory, it is required that 
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where (*) denotes the complex conjugate. Therefore, 

This equality requires that: 

S(-oj) = 5(uj) so that 5(0)) is an even function 
so that is an odd function 

Next, the trigonometric identity indicated below will be applied to 
the equation, above, for X^(t). 

— '.‘jv y ^ ( x + ^ ) +• co-^Cx— #)J 



CsCras 



( 
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/ ^ L “I 
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l n 
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co r - ( uo lajc.) 

dL oJ - - d.uj / 



^ He SuU-f'^^'°»5 recW//o^; 

Co-*, (“ X ) = Co-i> ( X) 

S (r 00 ) - S (co) 

(jfc (-co) - — ^ ( co) 
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uJ t + UJ L 



Ji>(oJ'-u; c ) co^[oj '± + Q -h cj)(oj '~u/ c j]jlto' 



UJc. 



u>c. - 0J L 

+ © +</>((*>'- u>c.)]Ju>' 

UJ C 



LO £ 



= JTflr Js(uj-<*; c ) 4-© -h (fi (to 1 ^-Oj ^ 



UJ 



u)/ 
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4- 
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tP,- UJ, 



To indicate that this is the transmitted signal, let X^(t) become X^(t) 
and combine both terms under the same integral with U) in place of OJ 4 • 

aJ c 4 0J L 

jrr Js (w-oj c ) c^\jjj± -b Q -+■ cf? (lo — uj c J co 

60 c - CU L 

During transmission, the signal will be changed in amplitude and phase 
due to the medium of transmission, noise, etc. Let the amplitude change fc<2 
denoted by A(u)) and the phase change by 3(^) . This phase change, 
along with phase slope due to tuned circuits in the receiver, will lead 
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to a time delay in the reception of the signal so, for a first-order 
approximation, assuming a dispersive medium , let 3 be treated as fol- 
lows. ~ y v 

^ (uj) = £>(uJc) 4 - (2 ( Co — uJc_ ) 

- Q (0J C ) -V- (3 C u> ') 

— (3 ( ^ c. ) — cf ^ * 

where ^ is a constant time delay. 

The signal arriving at the receiver, X„ ( t) is: 

u) c 4. oj { 



Xr L-t) — j!jp (U)-OJc) Ce*[oi-£ + & +■ (/>(*- UJ C ) 

+-(3(ul c ) + @(UJ-UJ C )] J.UJ 



U)c,-UJ L 



This signal will be demodulated by beating it with the local oscillator 
signal given below: 

X = cos ( 

where ^ is the phase of this reference signal. 

In an actual receiver, ^ would be automatically adjusted, by means of 
circuitry, to obtain and maintain carrier phase lock. 

The output from the demodulator, X^(t), is: 

X 0 U=) - X/? tt) ( co c t + 

<^C -bl>J L 

— eJTT J - w c J cers [_co + <9 
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->L 
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+ U) I 
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The first integral represents a signal with frequency components cen- 
tered about the second harmonic of the carrier and will be removed by 
means of a low-pass filter. In the second integral, assume that ) 

is constant in the frequency band centered at the carrier frequency so 
that the integrand is an even function. Therefore, the output from the 

filter, X^(t) is given by: 

/ uJl 

Xq ^ ' = Jnr J A S 0 oo-s '-t +■ C^O 4- (3(cj / )1JLuj / 

-J 

Lcih in (j Q (to — — d 0j/ A S c(>$co&%aJ c ; 

Xo L t)~ j ’ f) c CSh-$ |2 U)~i. -h $> Cui) — Uj £ ]Au) 

Xo U) = 

This is identical with the original data wave, s(t), modified in ampli- 
tude and delayed so the phase information, denoted by 0(cO), has been 
transmitted. 

In conclusion, it should be noted that the assumption that A( u) ) is 
constant and the definition of P (tO ) are not valid in all cases. For 
example, multipath effects would require a different treatment. Also, 
an interfering signal would disturb the received wave form and could 
cause much phase information to be lost in this, as well as nearly any 
other, communications system. 
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Figure 1. A Phase Modulation Model. 
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3. A Phase Modulation Demodulation System. 

In the foregoing paragraph, it was shown that phase information 
could be conveyed in a model in which the MODEM consisted of product 
modulators (demodulators) and filters when the data wave was a signal 
with some phase angle, cos ( U)t + 0) . To apply this to a digital com- 
munications system, we need some slight additions to be described be- 
low. Since our data is a series of 0’s and l's, we need a converter 
which will accept these and generate cos ( + 0) where 0 has one value 

if the data is 1 and another if 0. 



Figure 2. Converter. 

This converter, consisting primarily of an oscillator, phase shifting 
networks and delays, converts the binary datz^ to sinusoidal data waves 
and delays the first bit so that both output waves start at the same 
time. 

The modulator will be denoted as follows. 





0-6 + ©|) 



Figure 3. Phase Modulator. 
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This implies that letting 0 be 0° when that data is a 1 and 180° when it 
is a 0 requires only that polarity be detected in the receiver. 




Figure 4. Four-phase System (Modulator). 
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Consider the system shown in figure 4. The signals, s A (t) and s (t) can 

A B 



each be either cos ( w t;) or cos ( w t + 180 ) depending on whether A an 



m 



m 



B, respectively, are 1 or 0. The signal, X^(t) > will have a phase angle 



of either 0 or 180° but due to the 90° shift in the carrier, X (t) will 

1 B 



have a phase angle of either + 90° or -90°. The transmitted signal, 



X^(t), is a vector sum of X (t) and X (t). The operation of the sysr 

1 A 1 B 



tern is most clearly seen by looking at phasors* 



A=o 

4 - 



A = \ 



Xta W 



XtM 




A - l 
B a I 



or 



»3 =o 




B=| 



XtB (‘t) 



V B = 0 





6 - I 



A- o 
8=0 



/orm fit 

Cyclic) code. 



Figure 5. Phasors for the Four-Phase System. 
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The next item is a demodulator. 






Product 

DeMob. 



Xd (-£) 



f “ P (^c) + ©j 



"T" 

Ooo(a»e.t-+ 

Figure 6, Phase Demodulator, 

i 

Recall that X (t) is the same signal as X-(t) except that it has been 
delayed due to the velocity of propogation in the medium and the char- 
acteristics of the tuned circuits in the receiver. The amplitude change 
will not be included or considered here but will be considered in later 
paragraphs dealing with amplitude modulation. When the data wave is a 
sinusoid : 

Xr (-4.) r + c*i|(uJ c .-uj Wl yfc + 

Xd Li) - XrU) c^c ( ■*>«.-*• + y) 
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This constant can be used to break X (t) up into its A and B components 

K 



by making ( 0 - ) = 0 or + 90° . 
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Figure 7. Four Phase System (demodulator). 

The demodulation action is most clearly seen, again, by phasors. Let 
a = the phase of X^(t) which will be one of the four values shown 
in figure 5. 
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Figure 8. Demodulation Considerations. 

This indicates that the detection scheme considered above is actually 
a matter of determining polarity after the incoming signal has been 
demodulated. Therefore, the converter in figure 7 has only to determine 
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the polarity of X^(t) and X^^t) in order to be able to generate A 
and B. Before ending the phase modulation section, it should be noted 
that the detection scheme has been a fixed reference one as opposed to 
a differential detection scheme. This requires that phase and frequency 
of the carrier be available at the receiver* The MODEM scheme used is 
a DSB/SC one so these quantities must be obtained by either transmitting 
a carrier or generating the carrier (with phase shift, 0) at the receiver. 
One possible method of generating a phase-locked carrier is described in 
reference [ 2 ]. In this article, J. P. Costas proposes a synchronous 
detection scheme which combines the in-phase (I) and quadrature (Q) 
components in a phase discriminator. The components are combined in a 
manner which, along with frequency control circuitry, enables a local 
oscillator to obtain and maintain phase- and frequency- lock. 
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4. Amplitude Modulation - Demodulation Systems. 



The subject, amplitude modulation, being the oldest and most common 
modulation method, is covered quite thoroughly in textbooks and in the 
literature. With that thought in mind, I have decided to omit an extend- 
ed study of AM and to include only some systems which will be suitable 
to be used in this overall system. 

As a starting point, the necessary properties of the AM system 
should be described. The information to be transmitted is to be ob- 
tained from the amplitude of the carrier. In digital communications, 
this amplitude, ideally, will be one of two possible values depending 
on whether a 0 or a 1 was transmitted. In the non-ideal case, the two 
values of the amplitude are the expected values (means) of two random 
variables. Unless otherwise stated, these expected values will be used 
below. 

Let these two possible amplitudes be S and kS where k is non- 




Figure 9. Basic AM Signal. 

Note that, if k=0 , we have an elementary AM system in which one state 
of the system is represented by the presence of a carrier and the other 
state by the absence of the carrier. One final thought, before consid- 
ering specific examples of AM schemes, should be stated. In many AM 
methods, the phase of the carrier is changed when the carrier is ampli- 
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tude modulated. However, that is the basis of the PM system studied 
above. Therefore, a basic property of these AM systems must bef the 
requirement that the phase of the carrier be unaffected by the AM system. 

Consider, first, a variable-gain amplifier to accomplish amplitude 
modulation. The carrier is the input to the amplifier; i.e., it is 
applied to the control grid of a triode, tetrode, or a pentode. The 
modulating (information) signal is added to the DC plate or screen 




Figure 10. Variable-Gain Amplifier. 

Another system, currently being used, is the M A1 Data System* 1 
C 6 3* developed by the Bell System for the SAGE (Semi-automatic Ground 
Environment) system for continental air defense. In this system, the 
carrier is modulated by a ternary signal having relative levels of 1.00, 
0.73, and 0.27. The maximum level is used as a framing signal, while 
the two lower levels carry the binary information. A further descrip- 
tion and discussion of this system can be found in the reference cited 
above. 

In any case, envelope detection will be used in conjunction with a 
threshold device to distinguish between the two levels. This detector 
could be about anything from a full-wave rectifier to a much more elabo- 
rate system. 

As noted above, this section of the paper is not concerned with 
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specific systems or schemes because such a discussion would add little, 
if anything, to the picture. 

Let it be stated, simply, that the AM system will give us a two- 
level signal with negligible modification of the carrier phase. 
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5. 



The Combined AM-R4 System. 



In the preceding paragraphs, AM and IW systems have been discussed 
in some detail. Consider, now, the next stage in the development of the 
system. 



R1 system can approach half the full-channel capacity, predicted by 
Shannon, for a high signal to noise ratio. For a low (less than unity) 
signal to noise ratio, the capacity of a FM system approaches 79 % of the 
full-channel capacity while the AM system is limited to about 17%. 
Blackman further states that the full -channel capacity can be approached 
if AM and R1 are combined in the same system. This capacity is approach- 
ed, most closely, at low signal: to noise ratio. 

It will be the purpose of this paragraph to indicate how the AM and 
IM schemes can be combined into a single sub-system. Finally, several 
of these subsystems will be frequency-division multiplexed into a single 
system. 

The capacity of this system will not approach the capacity theo- 
rized by Shannon but it will combine a reasonably high capacity with 
fairly-low error rates. 

With this introduction in mind, let us consider the system. 



According to N. M. Blackman Cll, the capacity of either an AM or a 



Let: 
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SrU Vi) r 
Sr t 11 0 = 

Sr(no)-. 

Sr (lo/) = 
5 -r C/oo) - 

Sr (o/ 0 = 
St loio) - 

s r (° 0/ ) - 
S r (ooo) = 



Sfx 
F(u^c> 

> S T (///) 
F(Uc>oJ>») + 

Jz. S t(i°0 

F”( Wc. > uj ^ j / */• 

Js Sr (oil) 

f- ( Wt > w/jvt ; / 4- 

^ Sr (oo/j 



St ^ 

F > 9o°) 

P \ Ia) C. j L0-Vyi j ~* 9 ^ 

F (Wc^vj 9 s®) 
F (t*»c 4 ; - 



The set, S^,(X¥Z) represents the transmitted signal space for figure 



12. 




Figure 12. Signal Space for AM-IM System 




Figure 13. The AM-IM Demodulator Section. 
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With the exception of the envelope detector (or, more accurately, 
threshold type receiver), the components used in figure IS have been 
described earlier and will not be discussed here. 



The foregoing has been one way to combine AM and PM; i.e., phase- 
modulating an amplitude-modulated carrier. Another way could be the 
scheme indicated below. 



> Cgn\j 



DATA 



PM 

Ce>5 £ 






AM 

A. 






PM 



D« maJ 
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/A p 

Oemoc/ 
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C OAJV 



Data 



Figure 14. An alternate AM-FM System. 

The system shown in figure 14 is a bit more error-free than the original 
system because the carrier is transmitted. The system has a significant 
drawback, however, in that there is a good chance of sidebands over- 
lapping. 

Using the original system (figure 11 & 13), the " efficiency 11 of 
the system can be increased by frequency-division multiplexing several 
subsystems of the type shown in figures 11 and 13. 

A coding (error detection and correction or EDAC) scheme will be 
discussed below to permit minimum error rate for the capacity of this 
system. A block diagram of the entire system is given below. 
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Note: 3 Bits added for EDAC. 

Figure 15. The Complete AM-IM System. 
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6. 



Error Probability Considerations - The AM System. 
Define the following: 



p x 

P X (K) 



s 

N 

S 

< 

N 

< 

R 



Probability density function of 
Probability that X > X or 
fraction of the time that X x 
Instantaneous Carrier Amplitude 
Instantaneous Noise Amplitude 
Long-Term RMS Carrier Envelope 
Long-Term RMS Noise Envelope 



X 




Rand om 
Variables 




— = Average (Power) Signal-to-Noise Ratio 
N 

o 



erf( — ) = error function or probability integral 

N o £Uo 



yr- 

P x , y = P(X >Y) 



ft 2A/o 



Consider first, the Gaussian distribution. 




*3. 


- 


i <r z 


2 _ 


^n/inte (.3T,) 


Pz 


(x) 


= f [/- e<--f(X/-OPCjr)] 






P( 


HI 


>*)- £$[(*)<■*) — A + 


A 


r- e >? 5 






- Pt <*> + 1 - P x (r *) 










= a[i- (X/ffjrlS?)}* j- 




J - e r/ (-X /cj 



6 r"f (-x) ~ J /»e, eve* /o /> * 4 X 



■ ■■ p 3 (M c» = /- <=«-* (XAx-fiT) 
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For the case of Gaussian noise, the noise envelope, as well as the 
envelope of the carrier subject to fading, has the Rayleigh distribution. 



Therefore, consider the Rayleigh distribution. 

fx ~ ex / 2 (- zVa G-jf ) 
f^(x) - ex/3(“^<Sx a ) 



> o 



: x >o 



O f 






A* ofe »2- '^X'^ — Sq 
At this point, . several equations may be written. 

Carrier subject to Rayleigh fading: 

■= = fraction of the time that the carrier 

amplitude exceeds a level, E. 

Noise envelope amplitude: 

= fraction of the time that the noise 
envelope amplitude exceeds a level, E. 

The noise can be resolved into two components, N^. and Nq, [ 4 ], where 
Nj is colinear (either in phase or 180° out of phase) and is in 
quadrature with the reference. When "this is done, the fluctuations of 
each component have the Gaussian distribution and are given by: 

= /-er4(^M>) where 

a) = aj x + a/q Pjj x> £ or is the 

fraction of the time that the component is greater than a level, E. 
Consider, now, envelope detection of AM signals. 

Let a binary r^- Carrier Amplitude ^ 

where Q £. Ji. < | 

Assume that 1 and 0 are equally likely. 
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f ♦ 



5 i - ± c a 

- it -> 



-k (AS)* 



s. = v'^ 5 = /> S 

IvUre /I - * ~V^~ a 

T" — +*/ t- e s/r 6 /</ /eve./ ^ S< 

tjkerel O ■<£->< I 



Before continuing, consider the signal space which will be used in 
the following calculations. 



1 Region From figure 16(a), it can be 




To decide whether a signal represents a 0 or a 1, the noise vector is 
added (vector ially) to the signal vector. If the resultant vector lies 
anywhere within the circle, a'O* decision is made; if the resultant 
vector lies outside the circle, a'l 1 decision is made. Some examples of 
the system decision philosophy are given below. 
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1 decision 
error 




(c) 

0 transmitted 
0 decision 



no error 



<d) 

1 transmitted 
1 decision 
no error 



(e) 

1 transmitted 
0 decision 
error 



Figure 16 (b-e). The M Detection Signal Space. 

Case 1. No Carrier Fading. 

Assume the signal is kS; i.e., A "O" 



was transmitted. 

A B 




There will be no error if the resultant vector, kS + N, lies inside the 
square, ABCD (ideally the circle should be used but ABCD will be quite 

accurate). This requires:* 

(1) |(A5 < T or- c T — S 

/S In Un fi- 'h S 

(2) I }Jil <( t+As) rf Ajx is 180° a ui ©£ fok^sc 

(3) / AJq | < T 
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It can be assumed that and kS will be in phase half the time and 180° 
out of phase half the time. 

p[/Jo ar rsr uAe.» Q r Pi'Je.H./J , 3 A8C&J 



1 



0 trA« 






C./k>H |T|« ( I ) ft cl C £ > e V\ 

p t-e c. € d i f> 



^ = 0 -^ 

Z£±f -(«•*•# )»* -(*,iA)VTT 

"•> ' —w; — -* ' 

p 0 (m<3 error) S -j (^iW) 

P 0 (error) -P(a* firf-or tij k ga A O i4 m i i~h^,d ) 

— 1 - i~a <s rr-or) 

=ife 4)^ + i)-nr]} erf(«.yjr;J 



/\sso*v>(£ SIJ-Yifil is s J I.e, A 1 ujAi J-r/tAS M I v/crf , 
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There is an error if S+N is inside ABCD. If is in phase with S, 
it introduces no probability of error. If is 180° out of phase, there 
is an error if (S-T)< < (S+T) 

Therefore, for a detection error: 

(1) Nj must be 180° out of phase with S. 

(2) (S-T)< Nj < (S+T). 



( 3 ) 



K Q I < T 



P^ (error) = Prob. of an error when a 1 is transmitted. 

-r (I 1 - erf ^ 1 ^7 r )]“C / ” er *( s ~in ) J} 4 r 4 ( -fro ) 



C 3 ) 



- j +erj[(i+*)'fir]} tH&W) 

Is Anti o' S efufilly likely 
P (srrar) j -i- p e (firmer) 4. -5- p, ( 4( . rof j 

=^-c^(0.VTT)! J- er/[(«.- £)rir] 

- ec4[(*.i-£)-rp]-cr-fl(i- ~^)rr] c.< 



Case 2. Carrier subject to Rayleigh fading. 

In this case, the I & Q components of the signal are Gaussian, 
those of the noise are also Gaussian and, therefore, the I & Q components 
of S+N and kS+N are Gaussian. Therefore, the vectors, S+N and kS+N y are 
Rayleigh. 

When a 0 is transmitted, the signal is kS and there is an error if: 
(KfkS) > T or N > (T-kS) . 
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Pa (error) = P o f hS J T “ P [” T V 
= e/^[~(TV^ a z >/0+^^)J = e^Q- * a Rj(i+k*R)\ 

If a 1 is transmitted, the signal is S and there will be an error 

if: (S+M) < T" 

P , Career) = P T > + s - I ~ Ptf + Sj-r 

= |- eypQ-T 2 /(^+ 5 0 2 )] = I - et,o[-*' i So i '/(Aj 0 Z +S o 2 )] 

= | - ey.p^- dP P/ (I +• p)J 



A s s o tvi i /> e / / a q r> d Os cyvnlly I > k<z! y 
PC error) =: <4j- P 0 (error) P| (error) 



- j [ e.tpfc-of’R/ 0+&*)] + I ~ Cx/o[ r ^/?/0+^)j| 

= -£ +-$ e*pl^oPR./(i+k z £) ] - ^ e xp [-*>£/( /+£$ 



* Define a as the value of the threshold, a, giving a minimum P(error). 
To obtain a : 



6 P 



6 cj 



3U=Cb 



/+#i? 



a* R 

(a - '*-*« 




RCl, / 

77Fl e 




* It should be noted, at this point, that the foregoing probability 
equations are exact. Approximating the circle with a square was a 
mathematical tool which has served. Its purpose. 
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i+teft 77f)] 

a (-JJJLJ) - ,* ^ r ( 'IS '~ AZ A 
^Ki + JzsrJ- < ^ K l u+ *■**>( 1+*) 

, A v 2 _ (H-*)(l+& % &) , I l + 

} — 1 /+ -^^ / 



Substituting this into the equation for P(error) : 

Airte; 



U± B 



I + R 



P, (error) :s | 




“ ri . " 

R C l-‘h. x / 



P» (error)- . t + g v ~ 

0 \ R.U-A*)/ 

P (z rra r) — Q P, (error) -#- P e (e r-ror) J 




TT^TFr \~ 
B ' ro-a a ; / 
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' H-£ -0+* a *)l 
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0 v fc ( I - A 3 J 

n — I 
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>( z'u-AV ') 



VC 



8 



( 



/+ - 4 3 £ 
KU-je) 



>j / 



p (error) - 3 



I- 



1 ±JL 






C i-Jz*-) 

i iTJEF T 

v r'(T-a 3 )/ 



u> It e o — &> 



T+AiR. 

+te * */>+• f/ res A./*/ ", 
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Finally, some notes concerning a can be made. Referring to the 
appendix, it is noted that a is nearer to S than to kS in most cases. 
This is because the "instantaneous signal to noise ratio* 1 is higher if 
the signal is S (as opposed to kS) . 

The threshold, a, is set at levels dependent on R; the manner in 
which this is done is seen, most clearly, by an example. 



R - 1 



A - o. s’ 

S - 0.79 S 



A- = /.A£“A U 



e e 



»PP' 



ir/ « x) 



Ai 0 - S c = c. y<? S 

AJ — ^ o / , n cy = I > i 0 S 

Therefore: 1 , 00 S £ S * £ 2.10 S 

.S’© S ±(JkS)** l '(, 0 S 

where S*,(kS)* are random variables with means S and kS respectively. 

■\ 





Figure 17. Amplitude Relations. 

It can be seen, from figure 17? that the threshold, a, is set at the 
amplitude which will separate the random variables, S* and (kS)* the 
maximum amount of the time 

In this system, an optimum k ( ,, O n signal level) will have to be 
selected but the threshold, a, will be assumed to be adjusted to a, as 
R varies, by AGC-type circuitry. Therefore, the threshold will be at an 
optimum level for the values of k and R present at the receiver. 
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7. Error Probability Consideration Hi. 

Earlier, it was shown (see figure 5) that the phasors for the four- 
phase system are as shown below: 






Figure 18. Four-Phase System Signal and Noise Phasors. 

In figure 18, we see that the noise vector, N, when broken into colinear 
(Nj) and quadrature (Nq) components has several possible combinations of 
Nj and N^: 



Signal Vector 
(CS) 


Noise Vectors 
which could 
affect CS 


11 


-N t , -n. 




I Q 


01 


+N I> - n q 


00 


+N I» +n q 


10 


-N t , +N n 




V Q 



Figure 19. Noise and Signal Vectors. 

It should be stated that only one of the noise components given in the 
right-hand column of figure 19 need be present to cause a detection error. 
For instance, if the signal vector, CS, is 11, a noise vector containing 
any of the following components would cause an error: -N^., -N^, -N^. and 




41 



An example is shown below: 




Figure 20. Examples of effect of noise on Signal 11. 

Since this is a gray code, the noise phasors described above will 
cause the S 4- N phasor to be in an adjacent quadrant and only one of the 
two bits will be in error. In figure 20, it can be noted that one of 
the two bits will be incorrectly detected if the noise components have 
the sense indicated in the table and the magnitude of either N^. or is 
greater than CS cos 45°. 



Let be either L or N . 
C I Q 

Case 1. No Carrier Fading. 



P (e r t> r) — j^Pr o L , d J e"to /Jjr 4- due ~t~o 
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Pr o b , a { e T V o r- due 

t s r-/^A ~t-) Pr <9 lo ( ^ • ** C* S 00^ 45 0 ^ 

~ -A- Pt-o > C5 cxHi 46*"°) 

~ ir J , v cs - 4 " [j " £r “ <: ( ’ aJ^)] 

A- — .fdfL. - _ L -|/"7 -r ~7 * /) — ~|/ T±EF ^ 

Ho a)o ~ a ' R J ~ v-3~ 

,', PUrr-cr i)^ ) = ^ {> ~ £ ^ f • » * V^)] 

, , P Urro r) = Pa^- > .yc .5 + j 

= -£[/ - -*-^(.7 #V 7 T)] 



Case 2. Carrier Subject to Rayleigh Fading 
Assume "l" transmitted. 

The relative probability of carrier level, S, is given by 
Given a level, S, the IM error (from preceding page) is: 

i [1 - er_ f (' 7 m >)1 

/ t j^-(PCerror)) [l- c-r-f (•'7^)] &Xp(~S 
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P, (errflr 
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) ~ j'j-(Ptzrror)) 



s « o 



c*3 c<D 

= -a J[av(-sVs.‘)]|r^S -£[?$■ 



tie. £?Ld , step ft/ = h 



. CO 



P, Lerrar-) - (.~ /) J £ F =J — J F 



I I 



C & h $ i rl <? f- P - J 
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,<u 



A -v- 

i vrWr /» ^ ; 

'~\J~ — { Ji -v- ~ — (— 5 "^ / 5 <?^^) 

i/U = d[_£r-f("^^)J 



To obtain du, go back to the density function and distribution function 
of the Gaussian distribution. 



A - **r (-*?/**•■) 

Py = -5 + i ei-f ( 

/#■ 7 C 

P X *> r J'f > x^ c --j- + [fK^ x>o 

-wo o 
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This, recall, is the PM prob. of error, with a fading carrier, when a 
1 is transmitted*Similarly : 

P c (er^cr)= ] 

Finally, the probability of error in PM with carrier fading and an equal 
liklihood of transmitted l's or 0's is: 

P(error) = \ [p^(error) + P Q (error)] 
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8. Error Probability Considerations The AM-IM System. 

In this section, the pretense of no carrier fading will be dropped; 
henceforth, carrier fading with a Rayleigh distribution will be assumed 
as well as Gaussian noise. 

Consider a transmission group of 3 bits, ABC, where A is transmitted 
by means of an AM scheme and B, C, a IM scheme. These modulation methods 
are those described above. In this group there are possibilities of 1, 

2, or 3 bits being in error. 

Let: P St Prob (AM bit is in error) 



AM 






In the computer program (Appendix) these are denoted: 



P Am = 

Pp m = PRtH- PM 
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It would seem to be advisable, at this point, to discuss the compu- 
tations included as an appendix. All of the formulas used have been 
derived and discussed in preceeding sections. These formulas, with the 
computer program notation, are as follows. 

AKCT) =• Jk = " o " SlfHAl Le.vzl 

f-( (j) ~ — TUrn Laid /.eve/ 

/ . / I ±JZ \ 

“V + / 

pa^B cr) = P** 

--L jj 4- eyp{-(al) a R/OfA^)} -c >?{-(<£)*#/( / + R)j] 

PMBAC J*)* 





,/Csr^ - 


1 1 


4 L^“ 1 


1/ R+a 


Y A a ie+a J 



PZtBSCJ) = P(± P,~ PfiM + 

- PU ERR) - jR* s Roa, Ppm + PpM Pp* i 

p* LL ( t; “ P(3 rfc R) r p 3 = ^ ^ ^ 

At this point, the question of choosing k, the "0 M signal levels 
should be considered. Recall, k is the minimum instantaneous carrier 
amplitude as indicated in figure 9. which is reproduced below. 
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L e_ v « I 
Level 







Figure 9 (reproduced). Basic AM Signal. 

Two points are obvious at this point. For the lowest probability of 
error in AM, kS should be near zero while for HI, kS should be near S. 

A perusal of the computer printout of PROB-AM, PR0B-R1, P(2 ERR) or ' ; 
P(3 ERR) confirms this statement. However, a study of P(1 ERR) gives 
a hint to answering the question of the value for k. Consider the table, 
below, of the value of k minimizing P(1 ERR) as a function of R, the sig- 
nal to noise ratio. 



Figure 21. Table of k for minimum P(1 ERR) 

The best way to set the value of k would be to let it be easily 
changed so that it could be set at an optimum for the expected value of 
R. This value of R, of course, would depend on such factors as trans- 
mission path length and atmospheric conditions. If one value had to be 
selected, I would s&t k at about 0.4 because this would give a minimum 
average (mean) P(1 ERR) for the range of R used above. 



R(db) k (for min P(1 ERR) 
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A last remark concerning error probabilities deals with the effect 
of multiplexing several of these subsystems into one system as discussed 
earlier. At first thought, it would seem that putting five subsystems 
into a single system would increase the probability of a given number of 
bits being in error. This, however, is not the case. Although the 
number of ways of having this given error increase, the number of ways 
of not having it increase by the same proportion so that the probability 
of this error remains the same. 

Perhaps a clearer way to see this is to recall the probability and 
statistics <j/mmick of the urn with colored balls in it. If this urn con- 
tains one red ball and one black ball, the probability of drawing a red 
ball is one-half. If the urn contains 100 balls of each color, the 
probability of drawing a red ball is still one-half. 

This concludes the transmission problem of getting information from 
one place to another. In the following paragraphs, the concept of cy- 
clic coding will be introduced. Finally, the use of error detection and 
correction codes for this system will be discussed. 
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9. The Concept of Cyclic Codes. 

M The concept of cyclic, or polynomial, codes is considered one of 
the major breakthroughs in coding theory. M C5 ^ A cyclic code is defined, 
most clearly, by the property that makes it different from other codes: 
Any cyclic permutation of a cyclic code word results in another cyclic 
code word. 

Examples -- 

If a- , a 0 . . . a XT .a XT is a code word, then a XT a- . . . a c a.a XT - . 

1 2 N-l N N 1 5 6 N-l is a 

code word. 

The importance of cyclic codes stems, mainly, from the fact that they 
are easily implemented with shift registers. In the remainder of this 
section, we shall see how binary information can be represented by poly- 
nomials in a dummy variable. Following that, the principles of error 
detection and correction with cyclic codes will be discussed. Finally, 
the implementation of cyclic codes will be considered. Polynomial Repre 
sentation of Binary Information -- Consider a message coded into k bits 
with (n-k) bits added as a check. Think of the bits as a polynomial in 
X, a dummy variable. 

Example -- 110101 1 + X + X 3 + X 5 

These polynomials will be treated according to the rules of ordinary 
algebra except addition is done modulo 2. It should be noted that addic- 
tion and subtraction are the same in modulo 2 arithmetic. 

Therefore: IX 3 + IX 3 = OX 3 

ox a + ox a = ox a 
ox a + ix a = ix a 
-ix a = ix a 
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The message 



information 



check 



o— k bits — *3- (n-k) bits — 



n bits 



message 



Definitions 



P(X), degree (n-k), is the Generator Polynomial and is not divisible 
by x, 

A polynomial of degree less than n is a Code Polynomial (i.e. ac- 
ceptable for transmission) if, and only if, it is divisible 
by P(X). 

Therefore, code polynomials could be formed by multiplying any polynomi- 
al of degree less than k by P(X). Consider, however, the following meth- 
od which gives a code polynomial which has the properties that: 
Higher-order coefficients are message symbols, and 
Lower-order coefficients are check symbols. 

The method of forming code polynomials is that presented by Peterson and 
Brown in references Csl. The reader should bear in mind, however, that 
this is not the only method available to form code polynomials. 

To encode a message polynomial, G(X), divide xf^^GCX) by P(X)>then add 
the remainder, R(X) , resulting from the division, to X^ n ^^G(X) to form 
the code polynomial, F(X). 



Since Q(X)P(X) is a multiple of P(X), it is a code polynomial; therefore. 



x (n-k) G ( X ) = Q( X )p(x) + R(X) 





inder 



(recall, in mod 2 arithematic, addition = subtraction) 



F (X) = X < ' n ' k ' ) G(X) + R(X) = Q(X)P(X) 



X^ n k ^G(X) + R(X) = F(X) is a code polynomial’ 
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F (X) = X^ n ~ k ^G(X) + R(X) 

. degree less than (n-k). 

' zero coefficients in the (n-k) 

low-order terms. 

Therefore: (1) The k highest-order coefficients of F(X) are the same 

as those of G(X) which are the message symbols. (2) The (n-k) low- 
order coefficients of F(X) are the coefficients of R(X) and these are 
the check symbols. 




In an effort to understand what has been done, let us consider an 
example on the next page. 
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ctA^PLE — 



( ^ - i s’ A - i i 
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General Principles (EDAC) - - 

An encoded message (at the receiver) can be represented by: 



H(X) = F (X) + E(X) 




message 



polynomial having a non- 
zero term in each erroneous 
position. 



Because the addition is mod 2, F(X) + E(X) is the true message with 
erroneous positions changed. 

Two observations may be made at this point: 

(1) If H(X) is not divisible (evenly) by P(X), then an error has 
occurred . 

(2) If H(X) is divisible (evenly) by P(X), an error may or may not 
have occurred. 

Therefore, to insure an effective check, P(X), must be chosen so that no 
error pattern, E(X), which we wish to detect is divisible by P(X). 

The ability of a code to correct errors is related to its ability to 
detect errors. For example, any code capable of detecting all double 
errors can correct single errors. This can be seen by noting that if a 
single error occurs, we can try to correct it by trying to change each 
message symbol. A polynomial with one error and one symbol changed can 
be a code polynomial only if the erroneous symbol is the one which was 
changed. All other combinations are equivalent to double errors and, 
therefore, are detectable. Similarly, a code which detects all combi- 
nations of 2t errors can correct any combination of t errors; if t or 
fewer errors occur, changing all combinations of t or fewer positions 
results in a code polynomial only it all the erroneous positions are 
changed. The same argument shows that any code capable of detecting 
two error bursts of length b or less can correct any single burst of 
length b or less. Finally, the converse of the above is true; a code 
capable of correcting t errors can detect 2t errors, for example. 
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Detection Theorems. ~ 



The proofs of these theorems are given in reference 
Detection of Single Errors 



C 5 ] . 



Theorem 1 . 

A cyclic code generated by any polynomial, P(X), with more than one 
term ("at least 14-x") detects all single errors. 

Theorem 2 . 

Every polynomial divisible by (1-Hx) has an even number of terms. 

Lemma (a) Any code generated by P(X) = (14-x) detects any odd number 
of errors. 9 

Lemma (b) Since (1 4- x c ) = (14* x) (x° 4* x° 4* ...4*1), any 

P(X) containing a factor, (1 4* x c ) , will detect an odd 
number of errors. 

Double 6c Triple Error Detection 

A polynomial, P(X) , is said to belong to an exponent, e, if e is the 
least positive integer such that P(X) evenly divides (x e - 1) which is 
the same as (x e 4* 1) in mod 2. 

Theorem 3. 

A code generated by P(X) detects all single and double errors if the 
length, n, of the code is no greater than the exponent, e, to which P(X) 
belongs . 

Note : It can be shown that for any m, there exists at least one 

P(X) of degree m that belongs to e=2 m -l. This is the maximum 
possible value of e. Polynomials with this property (called prim- 
itive polynomials) are always irreducible. Thus, for any m, there 
is a double error detecting code of length n=2 m -1 generated by 
a P(X) of degree m. This code has m check symbols and 2 m -1-m 
information symbols. These codes are completely equivalent to 
Hamming single-error correcting codes. 

Theorem 4 . 

A code generated by P(X) = (1 + x)P^ (X) detects all single, double and 
triple errors if the length, n, of the code is no greater than the ex- 
ponent, e, to which P^ (X) belongs. 

Detection of a Burst-Error 

A burst-error of length b is defined as any pattern of errors for which 
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